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ABSTRACT 

In 1970-1971 LMS materials were made available to schools within 
the state of California under an Exclusive Use Agreement. Thirty-six 
districts including a total of 988 classrooms were involved. To meet 
the user training requirement, a protoype training system was developed. 

This document summarizes the evaluation of the protoype LMS train- 
ing system for Harper & Row and MacMillan Bank Street, grade 1, includ- 
ing the evaluation procedures and instrumentation used, as well as a 
summary of the findings. 
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TRYOUT AND EVALUATION OF PROTOTYPE LMS TRAINING 
SYSTEM UNDER EXCLUSIVE USE AGREFMENT 



The Learning Mastery System (IMS) is a set of materials and pro- 
cedures prepared by the Southwest Regional Laboratory as a supplement 
to the Harper & Row and MacMlllan Bank Street first grade reading pro- 
grams. LMS Identifies the learning outcomes taught in the reading pro- 
grams , and provides assessment and practice materials related to the 
outcomes identified. LMS is not a new reading program, but an objectives- 
based framework to assist in managing the learning activities of existing 
instructional materials. 

LMS materials for Harper & Row and MacMlllan Bank Street f grade 1, 
were made available to 36 school districts for use during the 1970-71 school 

year under an Exclusive Use Agreement. Included in the Laboratory's 

/ 

responsibilities was the provision of the training materials and pro- 
cedures necessary to train teachers in the appropriate use of the LMS 
materials. Specifications for the development of the LMS training 
system have been reported previously (TN 5-71-63). 

This document reports the data collected for formative evaluation 
of the training system using the 1970-71 Exclusive Use Agreement tryout 
as a vehicle. 

TRAINER TRAINING 

Training sessions » conducted by SWRL personnel, were held at the 
Laboratory for approximately 115 district trainers representing the 
36 school districts participating in the tryout (see Appendix A). 



\ 



The training program was designed to equip these trainers, selected by 
each district, to conduct training for all teachers using LMS. Figure 1 
lists, and briefly describes, each of the conqpbnents for both trainer 
and teacher training. 

In addition to the stated objectives for which the teacher training 
components had been developed, the trainer training sessions were intended 
to: (1) provide basic information about the program; and (2) present 
and clarify trainer functions related to teacher training. Figure 2 
is an agenda of the Training Session. 



FIGURE I 
TRAINING COMPONENTS 
LEARNING MASTERY SYSTEM y 

Laboratory Overview (f ilmstrip- tape) 

A brief description of the Laboratory, its function and goals. 

Trainer's Packet (printed rtnaterials) 

Guideline information on planning, scheduling, and conducting 
teacher training contained in the following enclosures: 

Scheduling the Teacher Training Program 

Considerations in planning the Teacher Training Program with 
specific suggestions and sample forms and agenda. 

' Trainer's Guide 

A detailed sunmary of^he steps to follow both immediately 
before and while -ctJnduc ting the training session. 

District Planning Considerations 

A number of considerations are listed to assist in identify- 
ing additional activities which require planning and 
scheduling. 

The Learning "Mastery System (filmstrip- tape) 

An introduction to the basic elements and rationale of the program. 

Manual and .Materials Overview (audiotape) 

An introduction and explanation of the materials and procedures 
used in the program. 

Teacher Training Kits (sample materials) 

Criterion Exercise, Unit 3 Auxiliary Exercise, Unit 3 

Class Record Sheet Practice Exercise, Unit 3 

Teacher's Manual 

Scoring. Recording, an'd Assigning Additional Practice (printed exercise) 
Sample Criterion Exercise results and a Class Record Sheet requiring. 



«> 



teachers to review the procedures involved in scoring and 
recording. '* 

IMS Questioiv-Answer Sheet (printed material) 

A suiranary of frequently asked questions and corresponding answers. 

I 
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FIGURE 2 

TRAINFR TRAINING 
AGENDA 
LEARNING MASTERY SYSTEM 

I. General Orientation 

A. Welcome and Introduction 

B. Laboratory Overview (films trip) 

C. Overv iew of Trainer Responsibilities 

D . Break 

II. I^IS Teacher Training Session 

A. Introduction 

B. LMS Overview (filmstrip) 

C. Manual and Materials Overview (tape and teacher kits) 

D. Scoring, Recording, and Assigning Additional Practice 

(exercise) 

E. Question-Answer Sheet and Discussion 
D . Break 

III. Discussion of LMS Trainer's Responsibilities 

A. Distribution and Check of Training Materials 

B. Review of Trainer's Responsibilities (Trainer's Packet) 

C. Reaction Sheet 
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As indicated in Figure 2, the training session was organized 
into\thr<se parts. Throughout the session, the SWRL trainer^ followed 
a Staff Trainer's Guide which provided introductions for each of the 
audio-visual components and a ^listing of informational items to be 
mentioned. In Part I of the training session, an overview of the 
trainer's responsibilities and resources, participants were shown the 
Laboratory Overview filmstrip and given a brief description* of each of 
the items included in the Trainer's PacKet*. During Part II, the UdS 
Teacher Training Session, Laboratory personnel assumed the role of district 
trainers using the Trainer's Guide, and provided basic program infor- 
mat ion. Part III provided a more thorough review of trainer respon- 
sibilities and a number of options available to the districts regarding 

t 

special installation and training procedures were discussed. 

» 

DATA COLLECTION 

/ 

Four primary data sources were identified for the evaluation of 
trainer training: observations of trainer training sessions, trainer 
response to trainer training, observations of teacher training sessions 
and trainer interviews. 

Observations of Trainer Training Sessions 

SWRL staff members conducted observations of two LMS Trainer 
Training Sessions held at the Laboratory. The obsefcVations w^re design- 
ed to record the information trainers received in the training session 
and to identify additional information required, as suggested by the 
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questions asked by the participants. The observation checklist, (see 
Appendix B) was based upon information which l^d been sequentially 
extracted from the Staff Trainer's Guide. * 

Trainer Reactions to Trainer Training 

Reaction Sheets, prepared by the Division of Resource Services, 
were intended to poll participant response to the training session and 
to elicit any questions, problems, or suggestions which may not have 
been dealt with during the session itself. 

Observation of Teacher Training Sessions 

As for trainer training, observations were made by SWRL personnel 
of eight Teacher Training Sessions, conducted in fiVe local school , 

\ ' - 

districts. Pre-selected aspects of trainer yerfonnance extracted 
from the Trainer's Guide were recorded using the observation form 
(see Appendix D). Questions and comments made by the participants were 
recorded to help point out areas of confusion. The observer's subject- 
ive assessment of participant reaction to the training session and the 
quality of training components were also noted. 

Trainer Interviews 

In March, 1971, SWRL staff members conducted personal interviews 
with xiistrict trainers in seven local school districts who maintained 
close contact with teachers throughout the year* Each interview con- 
sisted of a series of specific questions (see Appendix £) and any add- 
ition^y^comments or suggestions made by the coordinators. The inter- 
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views were intended to elicit further responses from trainers based on 
thair evaluation of the teacher training system and the training they 
received from SWRL to conduct teacher training, and teacher reactions 
to training, 

TEACHER TRAINING 

, Training for the approximately 988 teachers in the 36 districts 
usvHg LMS with Harper. & Row and/or ^MafcMillan Bank Street, grade 1 reading 
programs, were conducted by district trainers. Figure 3 is an agenda 
of the Teacher Training Session. 

' ^FIGURE 3 

LMS Teacher Training Agenda 

Welcome and Introductions 



Learning Mastery System 
(filmstrip and tape) 

Manual and Materials Overview 
(tape) 

» 

Scoring, Recording^ and Assigning Additional Practice 
^—(manual and exercise) \ 

Question-lnswer Sheet 

Briefing on District Requirements, Schedule, Resource 
Personnel, and Materials Distributions 

Discussion and Questions 
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To introduce teachers to the basic elements and rationale of the 
program, the f ilmstrip- tape , The Learning Mastery System , was used. 
Teacher^Training Kits, distributed at the session,. were reviewed in 
conjunction with the Manual and Materials Overview audiotape. Teachers 
using the MacMillan Bank Street version of LMS were instructed, by the 
trainer, in the procedures for administering the Placement Test. This 
information was not included in the tape reviev/ based on the Harper 6c Row 
materials. 

At the concl^usion of the materials review, the teachers were asked 
to complete the Sporing, Recording^^ and Assigning Additional Practice 



with the teachers. 



exercise, which enabled them to practice the Criterion Exercise pro- 
cedures. 

The LMS Questi^pn- Answer Sheet served as the basis of the question- 
answer period. Trainers were given the option of reading this infor- 
mdtion to teachers or merely sending it home 

DATA COLLECTION \ 

\ 

Two sources were identified for evaluation of the teacher training 
system: observations of th^ training system, and instructional pacing 

dat\a. 

Observations of Teacher Training Sessions 

SWRL observations of the eight Teacher Training Sessions described 
above resulted in the recording of questions and comments made by teach- 
ers,* as well as trainer perfoi^mance data. The questions and comments, 
arc summarized in Appendix F. 
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Instructional Pacing^ fiftta 

Undet the Exclusive Use Agreement, pacing and performance data were 
collected by SWRL throughout the-yearfrom 101 school9 In sixteen dis- 

tricts (Los Angeles zones are recorded' as distinct districts) using LMS. 

I 

Four pacing and performance status reports (January, April , ^May and 
June, 1971) were issued. 



RESULTS _ f 
Data collected from the two Trainer Training Sessions which were 
observe.d indicated that ^strict trainers received most of the informa- 
tion required to successfully couduct Teacher Training. The obi:erver 
checked eac^h item as it occu'rred andj recorded, verbatim, questions asked 
by the participants. Appendix D i^ a summary of these observations. 
Of the important information noi mentioned by the SWRL trainer during 
the sessions, the following had implications for improved trainer train- 
ing. - ' ' 

1. If the trainer is ^sisted by an audiovisual aide, he should 
be provided with a copy of the Trainer's Guide. 

2. The trainer .has the option of reading or paraphrasing ciMnponent 
introductions, if he chooSes to parajsi|irase he should include all 
of the points mentioned in ^e written introduction. ^ 

3. 'The SWRL staff trainer was tb have explained the role of place- 

ment tests and the pacing requirements of the program. 

4. The advisability of follow-up training sessions is mentioned 
in the trains materials, but was to have been emphasized in 
the Trainer Training Session. 
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The responses of district representatives recorded on the Reaction 
Sheets at the conclusion of each of th^ seven LMS Trainer Training 
Sessions (see Appendix C) , have been reported by Lasser (TN 4-70- ' ). 
The Reaction Sheets were completed at the conclusion of each LMS 
Trainer Training Session and immediately returned ^o the SWRL trainer. 
Ninety-four percent of the respondents indicated taey felt prepared to 
conduct training for others given thei' i , and additional time 

to-review the materials. When asked what specific modifications in 
materials they would make, 64 percent had none. Of the remaining 
36 percent, only the suggestions that materials be numbered sequentially, 
and that terms be more clearly defined, recurred consistently. Sixty i 
percent of the participants felt no change was necessary in the pro- 
cedures of sequencing of the training session. Ihe modifications most 
frequently suggested by the remaining 40 percent were: (1) slower pace, 
allowing time for questions as they^arose and time to review the materials 
more thoroughly; ^nd (2) an opportunity to review the'materlals prior to 
the training session. 

Table 1 summarizes trainer performance data gathered from the 
observations of Teacher Training Sessions. Trainers did perform almost 
all required behaviors during the training session. The exception involved 
those who ch9se to paraphrase the introductions to components and did 
not mention the important points contained in the written introductions. 
Tlie^e important points were mentioned in only 69 percent of the 41 
introductions paraphrased, adequate sound, visibility, and room ' 

i \ 



^^^Srkness were maintained in all. but one case (here, the recorder had 

to be turned so loud that the words were unclear). 1 

' ' \ * . - ' - ' \ • 

While the subjective comments of the- SVfRL observers at these ✓ 

Teactier Training Sessions (see Appendix F) dedlt primarily with teacher 

reactions and the quality of audiovisual components, they also note 

deviations from the training system procedures. Two trainers, dicing 

the Manual and Materials Overview tape, stopped the tape recorc^er to 

allow time for alL teachers to locate the referenced materials and to 

answer questions. At one tifaining session the f ilmstrip* tape component, 

Second ^ear jConiaunications Skills Program » Word Attack , was shown to 

give teachers practice in Word Attack skills and SWRL pronunciation of 

selected word elements. 

The following are areas with the highest frequency of questions 

asked by teachers during the Teacher Training Sessions observed by 

Sl^L (personnel. 

1. The amount df time re.quired by the program (4) 

2. Confusion as to the purpose* and use*of Practice Exercises (7) 
What to d(^ about slow children and the pacing schedule (3) 

Reports during teacher meetings and phone inquiries from the 
districts identify pacing as the major concern of teachers. 

I 

Pacing information was gathered from 63 schools in eleven districts 
using LMS with Har'per & Row, grade 1, and 38 schools in five districts using 
LMS with MacMill^n Bank Street, grade 1, under the Laboratory's Quality 
Assurance Plan. One district area (Los Angeles C - five schools) stopped 
submitting data after the initial pacing and performance report. Teachers 
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TABLE I 



SUMMARY OF TEACHER TRAINING OBSERVATIONS* 

Yes Nb 



\ 
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points 
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69 


28 
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the advancement of filmstrips 










and tape narration. 
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The trainer may advise teachers 










as to specific district pro- 










visions regarding : 










a. press releases 


0 


0 


4 


50 


b. follow-up training 


3 


38 


3 


38 


c. resource personnel 


4 


50 


2 


25 


d. materials distribution 


3 


38 


2 


25 


e. other 


0 


0 


2 


25 



*n=8 7 
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were directed" to mall Criterion and^ Auxiliary Exercises to SWRL when a 
majority of the children had completed a unit. The rei^orted unlt- 
completlOTl dates were matched against a schedule reflecting the 
recommended pacing. Only three percent of the Harper & Row classes » 
and none of the MacMlllan Bank Street classes monitored, had completed 
the text)>ook series by the end of t;he year. 

The results of the Interviews with district coordinator/trainers 
have been sunmarized by Puckett and Resta (TN 5-71-21). Of those 
interviewed,, three of the trainers indicated they had problems with 
the LMS training system. One trainer mentioned that teachers found 
the directions for scoring the Criterion Exercises difficult. A 
second trainer felt that considerable negative teacher affect could 
be attributed to the lack of a statement o£ rationale for the program 
and to the absence of training in SWRL blending, or word attack, pro- 
cedures. The third trainer's only difficulty was in an initial shortage 
of materials which was corrected before conducting the training sessions. 



CONCLUSION 

Available data indicated that the LMS trainer* training system did 
meet the objectives set for it. Appropriate facilities were arranged 
and the training sessions presented as specified lt^>^|:he trainer training 



materials. 



Teachers indicated they felt rushed into^ learning a new concept 

X 

and new terms in the short session. Teachers ^Iso suggested that word 
attack instruction would be a valuable addition to the progranio 
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The data collected from teachers, v/hile useful, did not answer 
the questions regarding training adequately enough to justify revisions 
based solely on the data. The teacher feedback reported was in general, 
unsolicited, and far from inclusive of the problems noted. In addition, 
there is no objective measure of teacher performance, as there is for 
district trainers. These data will be necessary for a valid evaluation 
and revision of the LMS Teacher Training System. 




1 



f 

/i7 



APPENDIX A 
LMS 1970-71 PARTICIPANTS 



\ 



DISTRICT 



No. of TRAINERS 



No. of TEACHERS 



\ 

\ 



ABC 

Anaheim 
Bakers field 
Bars Cow 
Beverly Hills 
Chula Vista 
Cuyama 
£1 Monte 
£1 Segundo 
£scondido 
Fuller ton 
Han ford 
Hermosa Beach 
Hueneme 
L.A, City 
Lancaster 
Long Beach 
Moreno Valley 
Mountain View 
National City 
Newport Mesa 
Oceans ide 
Oceanview 
Oxnard 
Palm Springs 
Palos Verdes 
Redondo Beach 
Rowland 

San Bernardino 
San Diego 
Santa Monica 
Santa Paula 
Savanna 
Simi Valley 
Torrance 
Valley Oaks 



Total 



36 




ERIC 



18 



APPENDIX B 

mS Trainer Training Observation Check List 



\ 



ERIC 



1. Welcome and Introduction 

2. Laboratory Overview (filmstrlp) 

3. OvervieV of LMS 

a. Harder and Row materials only 

b. Similar to Bank Street 

4. Review of trainer's packet 

a. Trainer's agenda--organizational rationale \ 

b. Role change at section II (trainers act as teachers) 
c* Discussion section is for questions 

d. Ihink of questions that teachers will ask 

5. Trainers packet 

a. It answers most questions 

b. It is a step by step guide 

c. Developed by SWRL and district experience 

d. Pull overview 

6. LMS Trainer's guide 

a. Walk through check list 

b. Note that this is where rol^ change occurs 

c. Recommend assistant for AV ^ 

d. Give assistant copy of trainer's guide 

e. Practice, if possible 

f. Explain component section 

g. Option of reading ^r paraphrasing introductions 

h. Go through trainer's guide to end of teacher training 
section 



Occured 
or 

Mentioned 



YES 
2 
2 

1 
1 

1 
1 
1 



_1. 
2 



NO 



Neither 
Marked 



1 
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7. LMS Overview (films trip- tape) 

Jl. lil.xplain placement tests and pacing 

b. No more than 2-3 weeks on readiness 

cl Need to complete many units because more skills 
taught as go along 

8. Manual and Materials Overview (tape) 

a. Hand out teacher kits 

b. Stop tape as necessary 

c. Hold up documents 

d. Point out error 

9. Scoring, Recording and Assigning Additional Practice 

a. Relationship of rows to outcomes 

b. Refer to page 13 

c^. Review recording on CRS 

d. Use correct Practice Exercises 

10. Question and,Ans »er Sheet 
a. Discussion 

11. Question Period . 

12. discussion of trainer responsibilities 

a. Establishing location and dates of training session 

b. Notification of participants 

c. Assignment of materials coordinator (district and 
school) 

d. Make-up training 

/ 

Provision of resource person l 
f. Training review session 



1 J, 
1 



2 

2 

2 

2 

1 _1 

2 

2 

1 1 

2 

^ 

^ 



2 
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13. Reaction Sheet 

14. Distribution of Training Materials 

a. Teacher lists 

b, AV will mailed 
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APPENDIX C 
REACTIONS TO TRAINING SESSION 



On the basis of today's session and with additional time to 
study and review the materials, are you prepared to train 
others in the proper use of this'Program? 

Yes No 

If your answer is YES, 



If your answer is NO, what specific assistance would be 
helpful? 



Please rank the activities listed below from 1 (most) to 

3 (least) in terms of th«> amount of time you anticipate 

you will spend in review and study prior to training teachers 



a. Manual and Materials Oveilview 

b. Assessment and Review 



c. , General Instructional Procedures 



3. What specific modifications would you suggest in the training 
materials used In today's session? 



> 



4, What specific suggestions would you make to improve the 
procedures or sequencing of the presentations in today's 
session? 



\ 
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OPTIONAL 



What kind of further assistance, if any, do you feel you need 
from the Laboratory? 



f f you would like to schedule an appointment to meet with a 
representative of the Laboratory to receive this assistance, 
please complete the fol lowing: 



ERLC 



/ 

/ 

i 



Name 



District 



Address 



Telephone Number 
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APPENDIX D 



LEARNING MASTERY SYSTEM TEACHER TRAINING 
OBSERVATION DATA SUMMARY 



WELCOME AND INTRODUCTION 

A. Welcome 

1. pleasant? yes 8 no 

2. positive? yes 8 no 

B. Introduction^ 

! I. read? paraphrased? 8 

If paraphrased, were the following 
points mentioned? 

a. purposf^ to acquaint with 
organization, content, and 

pro^dures of LMS? yes 6 no 

b. film describes rationale 

for program development? yes ^ no 

c. SWRL produced it? yes 6 no 



Tl, LEARNING MASTERY SYSTEM 

A. Introduction 

I. read? 1 paraphrased? 7 

If paraphrased, were the following 
points mentioned? 

a. describes LMS to accompany 
Harper & Row and MacMillan 
Bank Street first-grade reading 



\ 



an adjunct to regular first- 
grade reading program, not 
^n instructional program? yes 7 \_ no 



program? yes 5 no 

how LMS differs from textbook 

material? yes 1 no 
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B. Films trip and Tape 



1. 


adequate 


sound level 


ye. 




no 


2. 


adequat^^ 


visibility? 


yes 


8 


no 


3. 


adequate 


darkness? 


yes 


8 


no 


4. 


film and 


tape in synchronization? 


yes 


8 


no 



III. MANUAL AND MATERIALS OVERVIEW 
A. Introduction 

1. read? 2 paraphrased? 



If "paraphrased , were the following 
points mentioned? 

a. training kit is to familiarize 
' you with contents of Teacher's 

Manual? 

b. also to familiarize, vou with 
program material? 

c. scoring, recording, and 
assigning addit-onal practice 
and question-answer 

B , Tape 

1. adequate sound level? 

2. ♦ adequate pace that allowed 

participants to follow tape? 

3. were *a 11 participants following-* 
along with the tape? 



\ 



yes 5 no 1 _ not mentioned 

yes 3 no 3 not mentioned 

y®s 3 no 2 not mentioned 



yes 7 no 



not mentioned 



yes 5 no 2 not mentioned 
y^s 5 no 1 not mentioned 



IV. SCORING, RECORDING, AND ASSIGNING ADDITIONAL PRACTICE 

A. Introduction 

1. read? 1 paraphrased? 7 

If paraphrased, were the following 
points mentioned? 



a. quick practice of procedures 
to use of each unit. 



yes 



no 
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b» procedures Include scoring 

a Critei:ion Exercisci, recording 
scores on the Class Record 
Sheet, and if Practice. Exercises 
are required » 



yes 



no 



v.. QUESTION-ANSWER SHEET 
A. Introduction 

1. read? 3 paraphrased? 



If paraphrased, were the following 
points mentioned? 

a. provides comnon questions 
concerning_LMS? 

b. helpful in describing 
to others? 

c. also may suggest additional 
questions ^ 



yes 



yes 



no 



no 



yes 5 no 



VI. Were any provisions made in the following areas^ 



A. 


district press release? 

follow-up training? 
, resource personnel? 

materials distribution? 


yes 




no 


4 


not 


mentioned 


4 


B. 


yes 


3 


no 


3 


not 


mentioned 


2 


C. 


yes 


4 


no 


2 


not 


mentioned 


2 


D. 


yes 


3 


no 


2 


not 


mentioned 




E. 


OTHER: 


yes 




no 


2 


not 


mentioned \ 
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APPENDIX E 



INSTALLATION SYSTEM QUESTIONS 
INTERVIEWS (PERSON TO PERSON) 



Questions 1 through 4 apply only to those who did not conduct teacher 
trainings 

1. Did any problems arise for which your training or printed materials 
did not prepare you? 



/ 



2. Are there any changes you would make in the training materials or 

the way you were trained? (Scheduling the Training Session, Trainer's 
Guide, District Planning Considerations) 



Are there any specific questions about the program which you have 
been unable to answer for teachers? (If so, what are they?) 



4. Did you experience any difficulties in the manner in which the teacher 
training materials were acquired and disseminated? (If so, what were 



f 



Has $WRL's pro^^ram had an effect on any other part of your 
instructional program? (i»e», have non-SWRL.^rtlcipants become 
interested in objectives based curricula '^r crlfrrioiL referenced 
assessment?) 




/ 

Has SURL's program caused any reactions from the teachers? parents? 
community? (If "yes," begin a,b,c,d) 



a. What are they? 
Teachers: 



Parents: 



Community 



b. Which negative ones have continued throughout th^ entire year? 



c. Which negative ones disappeared early in the year? 



d. At what point did they disappear? 



-3- 



7. What was your position in the district before taking the teacher 
trainer task? 



8. What is your position now? 



9. What other SWRL-related tasks do you perform besides teacher 
training? (If applicable) 



10. What other tasks do you perform in your district? 



-V- 



li. Make a subjective judgement as to the Interviewer's enthusiasm for 



the program. 



/ 



very very 
enthusiastic enthusiastic 



er|c Ju 
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APPENDIX F 

QUESTIONS Altt) ANSWERS 
LMS TEACHER TRAINING OBSERVATION * 



I. Learning Mastery System 

(c) Q. Do we use the program (IMS) with those not using McMillian 
readers? , 

A. Only those using Harper and Row and Bank Street. All 
children in the class do not have to use LMS. 



(f) Q. How much time is allotted to this program? 
A, Normal amount 

(f) Q. Does it correlate with our follow-up program? 
A. No response 

(g) Q. I don't have aides. How can we use the program? 
A. It was designed with the single teacher in mind. 

(a) Q. What amount of time will it take? 
A. Two hours per unit. 

II. Manual and Materials Overview 

(e) Q. Where are the answere for the Practice Exercises and Auxiliary 
Exercises? 

A. In the manual. 

(g) Q. How are Auxiliary Exercises different from Practice Exercises? • 
A. No response 

(b) Q. If you use mothers to help with Practice Exercises, do they 

have to stay all day? 

A. No. A mother could come in for 15 minutes and drill a child, 
letters in parenthesis signify trainig session listed at end of Appendix 
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(g) Q. How do you find answers to Auziliary Exercises? 

A. No response . \ 

III. Scoring. Recording, and Assigning Additional Practice 

(a) Q. Can the Practice Exercise be given to a group? 
A. They can be - also before a Criterion Exercise. 

(a) Q. If a child misses "Janet" on Criterion Exercise, how will 
he know it on Practice Exercise? ^ 

A. You will have to teach the content. 

(a) Q. What ff instruction in Practice Exercise asks to read 
word #20 and child doesn^t know word #20? 

A. Each child goes through Practice Exercise twice, getting feed- 
back each time. 



(c) Q. Do you hold the whole class back until Practice Exercises 
have been given? 

A. No, keep program going day by day. 



IV. Questions Regarding Pacing 

(a) Q. What about a slow child? Do we make him finish a unit in 
three weeks? 

A. Assume they are developing readiness by other activities. 



(a) Q. (Lots on pacing.) 

A. These estimates are based on the average time 1st grade 
teachers took. You can group kids and go faster. 

(c) Q. What happens when pupils do not "get it?" 

A. After using Practice Exercises go on to the next unit. 



(b) ' Q. Is it possible we could have one or two children who are 
really slow and lag behind? 

A. Most children can keep up. You may have one or two, take 
more time with it. 
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V. General Questions 

(b) Q. Are you going to bring Practice Exercise to us? 
A. Yes, as you need them* 

^c) Q. I am already through the preprimer. Do I start over and 
use LMS? 

A. Give Criterion Exercises on those units covered and if 
they pass continue with LMS. 

(e) Q. Will we have enough materials for all our children? 
A. They are packaged 30 per pack. 

(f) Q. Will we get a different manual for Bank Street? 

1 

A. Yes\ 

(f) Q. What happens when 2nd grade teachers used materials? 
A. No response 




OBSERVER COMMENTS 
IMS TEACHER TRAINING OBSERVATION * 

% 

I. Learning Mastery System Welcome and Introduction 

(b) Very pleasant, informed atmosphere. (2) 

(a) Trainel^ stressed points of contract and that they should stick 
to pace. 

(c) Very attentive for such a large group. 

II. Learning Mastery System 
(\a) Tape awfully fast,* 

(b) Teacher kits were opened and gone through before they were 
introduced. Very attentive. 

(d) Teachers^vere bored to death. 

(d) Not enough placement tests - had to share them. 

>III. Manual and Materials Overview 

(a) Trainer stops at spots in tape so teachers can ask questions or 
can jot down questions to be asked later. (2) 

Pace too rapid. Tape was not stopped as suggested. When it 
got to Criterion Exercise, many were still looking at the 
training lesson. 

Train substitutes and parents in the program. 

Trainer: Practice Exercises may be given during regular 
instruction. If you have kids who have a lot of trouble use 
P.E. before C.E. 

Terminology "Criterion Exercise" confusing. 

Immediate reaction of skepticism regarding suggested pacing. 
Stated they were overwhelmed! 

Sample materials were held up by trainer and she added Infor-' 
mat Ion. 



(b) 

(a) 
(a) 

(a) 
(b) 

(b) (c) 
(g) (h) 



letters In parenthesis signify training session listed at the end 
of Appendix. 
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(c) Almost all teachers participated. 

(d) Much confusion in finding the right C.E. It seemed to work better 
when two people shared the materials, not so much dropping of 
papers. 



Scoring. Recording, an d Assigning Additional Practice 

(g) Too complex for aides. Films trip wasn't a sufficient teaching 
device. 

(b) Introduced rapidly. Some probably had questions that might 
have been answered before the exercise. Teachers did not 
understand the task asked of them. After five m^tes trainer 
explained position of outcomes on Criterion Exercise. (2) 

(a) Trainer calls auxiliary exercises, tests! 

(c) After chis exercise the CS II Word Attack Skills tape and 
films trip were presented. This was an effective addition to 
the LMS materials - perhaps the General Instructional Pro- 
cedures Films trip should be shown with IMS, too. 

(c) All of the teachers did not do the scoring, recording exercise. 
There may not have been enough to give each teacher one. 

(d) Most frequently asked - Why score 8? Rows across need more 
explanation. 



Learning Mastery System Question - Answer Sheet 

(b) Trainer read questions and answer too. Teachers were told 
that everyone is to be started in the program by 10/5. 

(c) Surprisingly, very few questions were asked. 

(b) In general - questions were not particularly encouraged. Every 
one was tired and wanted to go home. 
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LETTER CODE 








a. 


San Bernardino . 


9- 


16- 


•70 


b. 


Mountain View 


9- 


17- 


•70 


c. 


Rowland Unified 


9- 


22- 


70 


d. 


Torrance 


9- 


28- 


70 


e. 


Los Angeles - B 


10- 


12- 


70 


f. 


Los Angeles - B 


10- 


12- 


70 


g- 


Los Angeles - B 

/ 


10- 


15- 


70 


h. 


Los Angeles - B 


10- 


16- 


70 



/ 

/ 
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